Learning to Verify Safety Properties
نویسندگان
چکیده
We present a novel approach for verifying safety properties of finite state machines communicating over unbounded FIFO channels that is based on applying machine learning techniques. We assume that we are given a model of the system and learn the set of reachable states from a sample set of executions of the system, instead of attempting to iteratively compute the reachable states. The learnt set of reachable states is then used to either prove that the system is safe or to produce a valid execution of the system leading to an unsafe state (i.e. a counterexample). We have implemented this method for verifying FIFO automata in a tool called Lever that uses a regular language learning algorithm called RPNI. We apply our tool to a few case studies and report our experience with this method. We also demonstrate how this method can be generalized and applied to the verification of other infinite state systems.
منابع مشابه
Reachability checking in complex and concurrent software systems using intelligent search methods
Software system verification is an efficient technique for ensuring the correctness of a software product, especially in safety-critical systems in which a small bug may have disastrous consequences. The goal of software verification is to ensure that the product fulfills the requirements. Studies show that the cost of finding and fixing errors in design time is less than finding and fixing the...
متن کاملTowards Practical Verification of Machine Learning: The Case of Computer Vision Systems
Due to the increasing usage of machine learning (ML) techniques in securityand safety-critical domains, such as autonomous systems and medical diagnosis, ensuring correct behavior of ML systems, especially for different corner cases, is of growing importance. In this paper, we propose a generic framework for evaluating security and robustness of ML systems using different real-world safety prop...
متن کاملDesign and Psychometrics of an Assessment Tool for University Characteristics as a Learning Organization from the perspective of Educational Leaders
Introduction: Universities as learning organizations are places for transcendence, teaching, research and offering knowledge. The aim of this study was to design and assess psychometric properties of an assessment tool for university characteristics as a learning organization from the perspective of educational leaders. Methods: This mixed methods research was performed on faculty members of Te...
متن کاملActively Learning to Verify Safety for FIFO Automata
We apply machine learning techniques to verify safety properties of finite state machines which communicate over unbounded FIFO channels. Instead of attempting to iteratively compute the reachable states, we use Angluin’s L* algorithm to learn these states. The learnt set of reachable states is then used either to prove that the system is safe, or to produce a valid execution of the system that...
متن کاملA Safety-II Perspective on Organisational Learning in Healthcare Organisations; Comment on “False Dawns and New Horizons in Patient Safety Research and Practice”
In their recent editorial Mannion and Braithwaite provide an insightful critique of traditional patient safety improvement efforts, and offer a powerful alternative vision based on Safety-II thinking that has the potential to radically transform the way we approach patient safety. In this commentary, I explore how the Safety-II perspective points to new directions for organisational learning in...
متن کامل